I was curious why MTP affects PP TPS in llama.cpp. My PoC recovers it?

I’ve been running Qwen3.6-35B-A3B locally on llama.cpp and noticed that prompt processing throughput gets too low with MTP. I got nerd-sniped.

View Post on Scour ↗

More from Hacker News on Scour.

Discussed on Hacker News